CS168: The Modern Algorithmic Toolbox Lecture #15: Gradient Descent Basics Tim Roughgarden & Gregory Valiant May 18,

Source URL: web.stanford.edu

• Numerical analysis
• Mathematical analysis
• Mathematical optimization
• Convex analysis
• Operations research
• Convex optimization
• Gradient descent
• Derivative
• Convex function
• Linear programming
• Gradient boosting
• FrankWolfe algorithm

Convex Analysis and Optimization Chapter 1 Solutions Dimitri P. Bertsekas with

Source URL: athenasc.com

Convex Analysis and Optimization Chapter 4 Solutions Dimitri P. Bertsekas with

Source URL: athenasc.com

Convex Optimization Techniques for Signal Processing and Communication Zhi-Quan (Tom) Luo Department of Electrical and Computer Engineering University of Minnesota Minneapolis, MN 55455

Source URL: www.ims.nus.edu.sg

Variable Metric Forward-Backward algorithm for minimizing the sum of a differentiable function and a convex function Emilie Chouzenoux, Jean-Christophe Pesquet and Audrey Repetti ∗

Source URL: www.optimization-online.org

Push-Sum Distributed Dual Averaging for Convex Optimization Konstantinos I. Tsianos, Sean Lawlor and Michael G. Rabbat Abstract— Recently there has been a significant amount of research on developing consensus based al

Source URL: www.ece.mcgill.ca

A Stochastic Gradient Method with an Exponential Convergence Rate for Strongly-Convex Optimization Nicolas Le Roux Mark Schmidt Francis Bach

Source URL: nicolas.le-roux.name

Convex Optimization Theory Chapter 1 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology

Source URL: athenasc.com

LECTURE SLIDES ON CONVEX ANALYSIS AND OPTIMIZATION BASED ON LECTURES GIVEN AT THE MASSACHUSETTS INSTITUTE OF TECHNOLOGY CAMBRIDGE, MASS BY DIMITRI P. BERTSEKAS

Source URL: athenasc.com

Distributed Dual Averaging for Convex Optimization under Communication Delays Konstantinos I. Tsianos and Michael G. Rabbat Abstract— In this paper we extend and analyze the distributed dual averaging algorithm [1] to

Source URL: www.ece.mcgill.ca